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WHAT DO CORPORATE SOCIAL RESPONSIBILITY RATINGS 
REALLY CAPTURE? 


MAGALI A. DELMAS 
University of California, Los Angeles 


DROR ETZION 
McGill University 


NICHOLAS NAIRN-BIRCH 
University of California, Los Angeles 


The emergence of socially responsible investing has led to the development of a large 
number of methodologies for rating corporate social responsibility and to a growing 
body of research exploring the link between environmental and financial performance. 
Increased availability of information potentially generates an abundance of riches 
upon which to base investment decisions, but it also raises issues of commensurability, 
information overload, and confusion. Using a unique data set combining environmen- 
tal ratings from three leading purveyors, we identify the principal components of 
corporate environmental performance. We find that two distinct factors—the environ- 
mental processes and practices implemented by firms, and the environmental out- 
comes they generate—explain 80% of the variance of the data. We also find corporate 
financial performance to be associated to process but not to outcome measures. 


Socially responsible investing (SRI) is an invest- 
ment philosophy that uses screens based on envi- 
ronmental and social preferences to select or avoid 
investing in certain companies (Renneboog, Ter 
Horst, & Zhang, 2008). SRI has grown consistently 
in recent years, and currently more than 11% 
($3.31 trillion) of assets under professional man- 
agement in the United States are invested with 
social responsibility in mind (Social Investment 
Forum, 2012). As it gains in stature and legitimacy, 
SRI is in a unique position to orient corporations 
toward corporate sustainability because firms that 
pass these screens can attract capital more easily 
(Ambec & Lanoie, 2008; Chatterji & Levine, 2006; 
Delmas & Blass, 2010; O’Rourke, 2003; Siegel, 
2009). Consequently, as SRI becomes more preva- 
lent, firms may strive to improve their environmen- 
tal and social performance to be included in such 
indices (Chatterji & Toffel, 2010). 


255 


Unsurprisingly perhaps, as SRI has grown it has 
led to a proliferation of ratings to assess corporate 
social responsibility and environmental perfor- 
mance. Unlike financial performance indicators, 
which over time have become well defined and 
standardized, to date there has been no conver- 
gence upon universally accepted environmental 
and social performance indicators. In fact, more 
than 50 distinct rating methodologies for assessing 
environmental and social performance have been 
developed, more than a third of them since 2005 
(Sadowski, Whitaker, & Buckingham, 2010). In 
large part, these ratings are produced by small, 
specialized organizations aiming to provide nonfi- 
nancial performance indicators to supplement 
more traditional financial metrics. Yet, with an in- 
creasingly large number of ratings systems avail- 
able, it becomes less likely that each new method- 
ology will provide unique or complementary 
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information. Ultimately, the emergence of a wide 
variety of rating systems, coupled with the dispar- 
ity and opacity of the methodologies employed, 
calls into question the reliability and comparability 
of ratings, as well as their utility to investors, man- 
agers, and researchers alike (Porter & Kramer, 
2002). Because of the multiplicity of metrics, there 
is a risk that investors will lose confidence in SRI 
screens as a basis for investment decisions (Chat- 
terji & Levine, 2006). Furthermore, corporate man- 
agers might be confused on how to prioritize their 
investments in environmental and social improve- 
ments to bolster their firms’ reputation with inves- 
tors (Delmas & Blass, 2010). 

The proliferation of disparate rating methodolo- 
gies is attributable not only to the growth of SRI but 
also to the inherent complexity of “environmental 
and social performance,” an essentially artificial 
construct that can be interpreted and evaluated in 
many ways. Emphasis can be placed, for example, 
on greenhouse gas emissions, which contribute di- 
rectly to climate change, an issue that many con- 
sider to be the most dire of environmental con- 
cerns. But climate change is only one of many ways 
in which corporate activity touches the natural en- 
vironment. In fact, environmental concerns are ap- 
parent in many other domains, including issues as 
diverse as water usage, biodiversity loss, and the 
release of toxic materials. Likewise, corporate phi- 
lanthropy can be one element of social performance 
along with many others such as diversity in the 
workplace and employee benefits. How data are 
selected and aggregated in a single score inevitably 
prioritizes some issues over others, whether pur- 
posefully or not. Yet the proprietary nature of rat- 
ing methodologies often precludes full transpar- 
ency; as a consequence, little is known about the 
specifics behind each rating scheme (Chatterji & 
Levine, 2006; Delmas & Blass, 2010). 

In striving to clearly define the concept of “envi- 
ronmental and social performance,” scholars have 
both theoretically and empirically identified sev- 
eral dimensions that the construct encompasses. 
Yet, while there appears to be agreement that envi- 
ronmental and social performance is multidimen- 
sional and that the strength of the relationship be- 
tween each dimension and financial performance 
may vary, there is little consensus in the literature 
on what each dimension represents and thus what 
corporate social responsibility ratings actually 
measure. Moreover, in investigating these dimen- 
sions, scholars have disproportionately relied on 
ratings produced by one provider—KLD Research 


and Analytics—rather than using multiple inde- 
pendent ratings to more robustly capture the es- 
sence of environmental and social performance. 

In an effort to attain greater clarity on the mea- 
surement of corporate social responsibility (CSR), 
in this study we attempt to determine whether the 
information provided by leading rating organiza- 
tions can be reduced to a small number of unique 
dimensions that capture the cardinal aspects of 
CSR, and whether these dimensions are associated 
with financial performance. Empirically, we focus 
our attention solely on the environmental compo- 
nent of sustainability ratings. We do so for two 
reasons. First, environmental performance is cov- 
ered by a larger number of ratings schemes than 
social performance. Second, environmental perfor- 
mance is more easily quantifiable than social per- 
formance, and thus better suited for empirical anal- 
ysis. Greenhouse gas emissions, water usage, and 
recycling rates, for example, are more amenable to 
numerical representation than labor practices and 
stakeholder engagement practices (Global Report- 
ing Initiative, 2006). 

We examine the environmental evaluations of 
more than 200 U.S. firms as assessed by KLD Re- 
search and Analytics, Trucost, and Sustainable As- 
set Management (SAM) from 2004 through 2007. 
These sources of performance ratings have been 
used in more than 100 management research arti- 
cles.’ Our study is the first to explicitly triangulate 
data from these different independent sources. This 
triangulation reveals that two dimensions—envi- 
ronmental processes and environmental out- 
comes— explain roughly 80% of the variance of the 
data. The process dimension captures the manage- 
ment practices that firms put into place to improve 
their environmental performance. The outcome di- 
mension captures the effects of these practices on 
actual environmental performance currently in 
place in the organization. We find that the process 
dimension of environmental performance is more 
significantly related to financial performance than 
the outcome dimension. These results can inform 
both managers and investors on the elements of 
social and environmental performance that are the 
most likely to be linked to financial performance. 


ENVIRONMENTAL RATINGS 


Socially responsible investing is based on the 
assumption that good environmental performance 


1 See appendix for a list of these studies. 
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can be associated with good financial performance 
(Siegel, 2009). There are several rationales for this 
assumption. First, by reducing the amount of ma- 
terials and energy used in industrial activity, cor- 
porations become both greener and leaner, reduc- 
ing their production costs and thereby increasing 
profitability (King & Lenox, 2001). Similarly, by 
reducing emissions and wastes, firms reduce both 
waste management costs and fines that result from 
noncompliance with regulations. In doing so, firms 
also reduce the exposure they will face if and when 
future regulations come into effect (Reinhardt, 
1999). Furthermore, by establishing a reputation as 
a responsible organization, a corporation can both 
reduce the effect of adverse environmental mishaps 
on its valuation (Doh, Howton, Howton, & Siegel, 
2009; Godfrey, Merrill, & Hansen, 2009) and also 
benefit from supportive and long-lasting relation- 
ships with a wide array of stakeholders, including 
employees, customers, suppliers, communities, 
and of course investors (Delmas, 2001; Delmas & 
Montiel, 2009; Delmas & Pekovic, 2013; Free- 
man, 1984). 

Whether these theoretical predictions also hold 
in reality has been the subject of a great number of 
studies (Barnett & Salomon, 2006; Brammer & Mil- 
lington, 2008; Dowell, Hart, & Yeung, 2000; King & 
Lenox, 2001; Marcus & Fremeth, 2009; Ram- 
chander, Schwebach, & Staking, 2012; Russo & 
Fouts, 1997; Sharfman & Fernando, 2008; Waddock 
& Graves, 1997). Yet despite this large body of 
research, much uncertainty about the significance 
of the relationship remains. Meta-analyses, which 
aggregate results from individual studies, suggest 
that the link between environmental and financial 
performance is weak (Margolis & Walsh, 2003; Or- 
litzky, Schmidt, & Rynes, 2003). Nonetheless, the 
financial consequences of being perceived as a so- 
cially and environmentally responsible corporation 
can be significant. For example, Lyon and Shim- 
shack (in press) have shown that merely appearing 
in the top 20% of Newsweek’s prestigious Greenest 
Companies list yields an immediate measurable in- 
crease in stock valuation, even though the data on 
which the list is based is readily available to the 
market before the list is announced. 

These mixed results, according to some, might be 
partly due to misspecified models, the difficulty of 
measuring environmental performance, and impor- 
tant differences among screening methodologies 
(Griffin & Mahon, 1997; McWilliams & Siegel, 
2000, 2001). Indeed, rating methodologies for envi- 
ronmental performance are as varied as the data on 


which they are based (Delmas & Blass, 2010). How- 
ever, disparate methodological approaches that can 
be viewed as suboptimal can also provide insight 
and perspective (Ilinitch, Soderstrom, & Thomas, 
1998). Akin to distinct measures of financial per- 
formance, such as Tobin’s q, return on assets 
(ROA), and return on equity (ROE) (Chakravarthy, 
1986; Venkatraman & Ramanujam, 1986), distinct 
methodologies for assessing environmental perfor- 
mance add nuance to a complex concept. This va- 
riety gives investors and other audiences several 
options to evaluate performance and inform deci- 
sion making. However, whereas environmental 
performance is a construct no less complex than 
financial performance, its underlying dimensions 
are not as clearly defined or well understood. 


Two Dimensions? 


Researchers have developed various models for 
conceptualizing the corporate environmental per- 
formance (CEP) construct, most of which identify 
two dimensions. Several recent studies posit a clear 
distinction between doing environmental “good” 
versus “bad.” In other words, these studies suggest 
that positive environmental performance and neg- 
ative environmental performance are not mirror 
images, and therefore one cannot be expressed as a 
linear transformation of the other. Minor and Mor- 
gan (2011), for example, claimed that by “doing 
good” firms aren’t necessarily “avoiding harm” to 
the environment. Similarly, Mattingly and Berman 
(2006) corroborated the claim that positive and neg- 
ative social actions are empirically and conceptu- 
ally distinct aspects of a more general social per- 
formance construct. Strike, Gao, and Bansal (2006) 
also showed that responsible and irresponsible so- 
cial behaviors require separate measurement and 
that each has a distinct correlation to financial 
performance. 

Other researchers have identified dimensions of 
corporate environmental performance based on the 
target stakeholder group. Focusing on the financial 
consequences of social actions, Hillman and Keim 
(2001) differentiated between actions aimed at pri- 
mary (e.g., employees, customers, and communi- 
ties) versus secondary stakeholders (e.g., those as- 
sociated with social issues not directly related to 
the firm) and demonstrated that only the former are 
associated with profitability. Researchers have also 
dichotomized social and environmental ratings as 
forward- versus backward-looking. In their assess- 
ment of the accuracy of KLD environmental ratings, 
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Chatterji, Levine, and Toffel (2009) emphasized the 
need for ratings to capture both historical environ- 
mental performance and current managerial prac- 
tices. They find that KLD ratings do not make op- 
timal use of publicly available environmental 
performance data. In sum, prior research reveals 
that environmental performance is not a unidimen- 
sional construct, and suggests that it may be cap- 
tured rather comprehensively with two dimen- 
sions—although precisely what these two 
dimensions represent remains unclear. 

In this paper, we build upon a two-dimensional 
view of social and environmental ratings that dis- 
tinguishes between processes and outcomes (Busch 
& Hoffmann, 2011; Chen & Delmas, 2010, 2012; 
Wood, 1991). Outcome-based measures take into 
account only environmental impacts whereas pro- 
cess-based measures consider internal efforts, such 
as commitment to environmental causes, sophisti- 
cation of environmental management systems, and 
managerial quality in general (Chen & Delmas, 
2010). In other words, process-based measures rep- 
resent the actions that firms take that in turn affect 
the firm’s environmental performance. 

Process and outcome measures differ in several 
ways. First, process-based measures are often in- 
tangible and more difficult to measure than envi- 
ronmental outcome such as toxic releases. Second, 
process measures indicate the efforts a company 
invests in attempting to mitigate its environmental 
impacts. Although process measures represent a 
potential for improvement in outcome perfor- 
mance, there is no guarantee that such improve- 
ments will indeed materialize (Schneider & Meins, 
2012). It is therefore unclear whether the two di- 
mensions can or should be used independently by 
socially responsible investors. For example, using 
survey responses, Busch and Hoffmann (2011) 
found that their outcome-based measure—self-re- 
ported greenhouse gas emissions—had a positive 
relationship with financial performance, while the 
opposite was true for process-based measures. 


METHOD 
Environmental Performance Ratings 


We examine environmental performance ratings 
produced by three different rating organizations: 
KLD, Trucost, and SAM. The widespread reliance 
on these ratings in scholarly publications is de- 
picted in the appendix. These three rating schemes 
are also highly visible not only to investment man- 


agers and executives but also to general audiences 
more broadly. For example, the Newsweek Green 
Rankings are based in large part on data from KLD 
and Trucost (Lyon & Shimshack, in press). SAM 
provides the data for the world’s first family of 
sustainability indices, the Dow Jones Sustainability 
Indexes (Cerin & Dobers, 2001). 


KLD 


KLD Research and Analytics rates the environ- 
mental and social performance of all firms listed on 
the Russell 3,000, representing approximately 98% 
of the investable U.S. equity market. The KLD da- 
tabase creates seven individual binary “strength” 
and “concern” scores, respectively, across a range 
of environmental performance categories, includ- 
ing products and services (e.g., beneficial products 
and services and agricultural chemicals); opera- 
tions and management (e.g., pollution prevention, 
recycling, management systems, and substantial 
emissions); and climate change (e.g., clean energy 
and revenues from coal, oil, and derivative prod- 
ucts). These assessments are based on publicly 
available information from a comprehensive set of 
media providers; they do not rely at all on data 
provided by the companies themselves. While thus 
ensuring greater objectivity, KLD ratings are much 
less granular than those found in other methodol- 
ogies, capturing primarily noteworthy environmen- 
tal activity, whether positive or negative, as re- 
ported by media sources. This is by far the most 
widely used data set in research on environmental 
performance (Chen & Delmas, 2010; Etzion, 2007). 


Trucost 


Trucost performance indicators quantify a broad 
range of environmental impacts for the largest pub- 
licly traded U.S. companies, including all Standard 
and Poor (S&P) 500 firms. The variables cover both 
direct and supply chain activities, such as emis- 
sions and waste production, water abstraction, nat- 
ural resource use, and raw materials extraction. 
Where it is available, Trucost collects, standard- 
izes, and validates company-reported environmen- 
tal data from annual reports, corporate Web sites, 
and other public disclosures. Where not disclosed 
publicly, data are calculated from global fuel use, 
or imputed by conducting a detailed sector break- 
down of each firm and applying a proprietary in- 
put-output (IO) economic model based on govern- 
ment census and survey data, industry data and 
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statistics, and national economic accounts. Trucost 
then quantifies the various environmental impacts 
and damage costs associated with these extractions 
and emissions using methodologies developed in 
the environmental economics literature, which are 
vetted by an independent academic advisory panel. 


SAM 


Sustainable Asset Management (SAM) is a Swiss 
company specializing in sustainability invest- 
ments. Its rankings focus primarily on the largest 
2,500 companies (by market cap) listed in the Dow 
Jones Wilshire Global Total Market Index, which 
comprises the largest firms in developed and 
emerging markets. Unlike KLD, the basis of SAM’s 
rating methodology is firm responses to sustain- 
ability surveys, performed and analyzed annually. 
SAM asks companies in its universe to fill in de- 
tailed Web-based questionnaires regarding various 
aspects related to their economic, social, and envi- 
ronmental performance. Response rates are roughly 
20%. An additional group of companies, also com- 
prising around 20% of the SAM universe, is ana- 
lyzed with publicly available information. These 
are firms that have participated in past surveys, or 
that SAM analysts believe are especially worth- 
while of coverage, usually because they are large. In 
sum, analysis is available for around 40% of the 
world’s largest companies. 


Measures 


We extract from each of the three data providers 
the most significant measures of environmental 
performance that have been used in the literature 
(see Table 1). Based on the KLD data, we create two 
variables—Total concerns and Total strengths— by 
separately aggregating all environmental strength 
and concern scores, respectively, for each firm. 
From Trucost we use the Total damage cost vari- 


able for each firm, which aggregates all direct and 
indirect damage variables. From SAM, we use two 
measures: eco-efficiency and environmental report- 
ing. Eco-efficiency is based on comparison of re- 
source inputs (i.e., water use in cubic meters and 
total energy consumption in giga-joules) to outputs 
(i.e., greenhouse gas emissions in metric tons of 
carbon dioxide equivalents and total waste genera- 
tion in metric tons), but the measure puts a higher 
weight on the resource inputs than the outputs. 
Reporting evaluates the quality and degree of trans- 
parency in environmental reporting based on com- 
pany disclosures and reports. 

Our analysis incorporates all firms common to all 
three data sets, essentially encompassing the larg- 
est public U.S. firms in the years 2004 through 
2007. Merging these data yields an unbalanced 
panel encompassing 475 firms and a total of 1,072 
complete firm-year observations available for the 
principal component analysis (PCA) portion of our 
analysis. Tables 2 and 3 provide descriptive statis- 
tics and correlations. 


Stage 1: Principal Component Analysis 


We use PCA, a method developed to reduce the 
dimensionality of a data set in which there are a 
number of interrelated variables while retaining as 
much of the variation as possible (Jolliffe, 2002). 
PCA replaces p correlated variables with q uncor- 
related variables (called “components”) in a way 
that minimizes loss of information, where p > q. 
Each component is a linear combination of the 
measured variables: 


X 


HY dıjX1 T ad2;X2 + SRTR + dp; p? 


Where x1, Xz... Xp are the standardized original 
measurement and the a;; s are coefficients for vari- 
able i on component j. The coefficients reflect the 
relative contribution each variable makes to the 


TABLE 1 
Environmental Ratings Descriptions 
Ratings Variable name Description 
KLD Total Concerns Total environmental concerns: Hazardous waste, regulatory problems, substantial emissions, 


climate change 
Total Strengths 


Total environmental strengths: Beneficial products and services, pollution prevention, 


recycling, clean energy, communication, management systems 


Trucost Total Damage Cost 
SAM Eco-efficiency 
Reporting Environmental reporting 


Total environmental damage cost (mUSD) associated with firm activity 
Energy and water usage (inputs) vs. GHG emissions and waste (outputs) 
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TABLE 2 
Descriptive Statistics 
Variable Obs. Mean Std. dev. Min. Max. 
Trucost Total Damage 741 665.23 1,314.77 1.21 13,323.73 
KLD Total Concerns 741 0.63 1.09 0.00 5.00 
SAM Eco-efficiency 741 21.45 34.09 0.00 100.00 
SAM Reporting 741 36.56 36.93 0.00 100.00 
KLD Total Strengths 741 0.54 0.90 0.00 4.00 
PC Environmental Processes 741 0.09 1.04 —2.91 3.42 
PC Environmental Outcomes 741 0.04 1.03 —1.47 6.94 
Leverage 741 —2.55 3.45 — 16.12 0.24 
Growth 741 — 2.36 0.99 — 16.12 —0.32 
Capital Intensity 741 — 2.99 0.97 —6.69 0.38 
Firm Size 741 9.05 1.25 6.10 12.53 


component, and are commonly rescaled to reflect 
the most important components. The rescaled co- 
efficients are called component loadings and are 
interpreted as the correlation coefficient between 
variable i and component j. Each component y, 
accounts for a portion of the overall variation. The 
principal components are the q components that 
account for the highest amount of variation. By 
construction, the components are orthogonal to 
each other and thus describe a unique dimension of 
variation. The components can therefore be inter- 
preted by examining how the variables in each 
subset relate to one another and, in turn, are dis- 
tinct from other subsets. 

In the first part of our analysis we used PCA to 
identify the principal components captured by the 
three methodologies. Column 1 of Table 4 describes 
the results with a varimax rotation, which yields 
components orthogonal to each other. This rotation 
is advantageous for highlighting the distinction be- 
tween components, but in instances when compo- 
nents are not likely to be independent, a non-or- 
thogonal rotation may be preferable. Column 2 thus 
presents the results of principal component analy- 
sis with a promax rotation, which relaxes the or- 
thogonality constraint. With the varimax rotation 


TABLE 3 
Correlation Matrix of Environmental Ratings 


Variable 1 2 3 4 5 


Trucost Total Damage 1.00 

KLD Total Concerns 0.61 1.00 

SAM Eco-efficiency 0.35 046 1.00 

SAM Reporting 0.32 044 0.76 1.00 

KLD Total Strengths 0.23 0.38 0.66 0.58 1.00 


OF &@ N = 


All coefficients are significant at the 5% level. 


the two most significant components account for 
nearly 80% of the variance in the data, and with the 
promax this number rises to nearly 95%, suggesting 
that indeed environmental performance can gener- 
ally be disentangled into two primary dimensions. 
These results suggest that the processes that a com- 
pany employs to be “good” and reduce its environ- 
mental impact constitute one dimension, whereas 
its actual impacts—the “harm” it generates in terms 
of releases to the environment and damages that 
these releases create—constitutes a separate di- 
mension. We label the first dimension PC environ- 
mental processes and the second dimension PC 
environmental outcomes. The Environmental pro- 
cesses component includes the variables Total 
strengths from KLD and Eco-efficiency and Report- 
ing from SAM. These variables primarily represent 
the adoption of environmental management prac- 
tices and reporting and also provide some indica- 
tion of resource inputs. The Environmental out- 
comes component includes the Total concerns 
variable from KLD and the Total damage variable 
from Trucost, which both represent environmental 
outputs or outcomes. 


Stage 2: Financial Impact 


In the second stage of our analysis we used panel 
data analysis to examine the relationship between 
each of the two principal components and firm 
value. Below we describe the variables and 
methods. 

Dependent variable. Tobin’s q was used to mea- 
sure firm value. Tobin’s q is defined as the ratio of 
a firm’s market value to the replacement cost of its 
assets, which this study approximates using the 
method developed in Chung and Pruitt (1994). To- 
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TABLE 4 
Principal Component Analysis 
1 2 
Orthogonal rotation Oblique rotation 
(varimax) (promax) 
Environmental Component Component 
Data performance 

source variable 1 2 1 2 
SAM Eco-efficiency 0.87 0.26 0.88 0.07 
SAM Reporting 0.85 0.24 0.86 0.06 
KLD Total Strengths 0.85 0.11 0.89 —0.08 
KLD Total Concerns 0.11 0.92 0.15 0.81 
Trucost Total Damage 0.32 0.83 —0.10 0.96 

Eigenvalue 2:32 1.66 2.67 2.07 

Variance Explained 46.34% 33.17% 53.41% 41.34% 

Cumulative Variance Explained 46.34% 79.50% 53.41% 94.75% 


bin’s q is widely used in empirical studies of the 
environmental—financial performance relationship 
(Busch & Hoffmann, 2011; Dowell et al., 2000; King 
& Lenox, 2002; Konar & Cohen, 2001). 

Independent variables. The two principal com- 
ponents PC environmental processes and PC envi- 
ronmental outcomes constituted our independent 
variables. Each principal component is a linear 
transformation of the original five environmental 
variables. 

Control variables. We included several financial 
variables to control for firm-level heterogeneity. 
Firm total assets are used to account for variation in 
Firm size, while Leverage is approximated by the 
ratio of total debt to total assets. We included the 
variable Growth, defined as the annual change in 
sales divided by total sales, to control for variations 
in production (King & Lenox, 2002). Capital expen- 
ditures divided by total sales was used as a measure 
of Capital intensity (Elsayed & Paton, 2005; King & 
Lenox, 2002). Although it was suggested as a nec- 
essary control variable (McWilliams & Siegel, 
2000), due to a prohibitively large number of miss- 
ing values for Research and development expendi- 
tures in the Compustat database, this variable 
was not included in our analysis. To correct for 
skewed distributions, each of the financial control 
variables was transformed using the natural loga- 
rithm. Finally, year and industry dummy variables 
controlled for annual trends and differences across 
18 sectors. 

Analysis. Our model of firm financial perfor- 
mance is: 


Yir = A; + PX + py, 1 = 1, a 


Where y+ is the financial performance of firm i 
in year t + 1, a; is the unobserved firm-level effect, 
and ß is the vector of estimated regression coeffi- 
cients for each of the explanatory variables mea- 
sured in the matrix, X (Wooldridge, 2006). To ac- 
count for the time it takes for environmental 
information to become available to the market 
(Chatterji et al., 2009), the observations in X are 
lagged one year behind the dependent variables. 

Coefficients were estimated based on a random 
effects model. A random effects model is appropri- 
ate when the number of panels (i.e., firms) greatly 
exceeds the time dimension, as is the case with our 
unbalanced sample (475 firms over four years). 
Randomly assigning the firm-level effect allows for 
estimation to be based on variation across firms. 
The fixed effects model, although a conservative 
approach, relies on variation within firms (Baltagi, 
2005). We thus based our model choice on the 
structure of our panel data (Baltagi, 2005; Dowell et 
al., 2000; Elsayed & Paton, 2005). 

Table 5 contains the correlation matrix of regres- 
sion variables; regression results are described in 
Table 6. Calculating Tobin’s q requires a relatively 
high number of financial variables, making it sus- 
ceptible to missing values. As such, the sample size 
for the regression analysis is reduced. We focus on 
models 3 and 4, which include the PC environmen- 
tal processes and PC environmental outcomes vari- 
ables. Model 3 uses the results of the varimax rota- 
tion; model 4 uses the results of the promax 
rotation. Both show that PC environmental pro- 
cesses has a significant and positive impact on To- 
bin’s q (p > .001). The estimated marginal effect 
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TABLE 5 
Correlation Matrix of Regression Variables 
Variable 2 3 4 5 6 7 8 9 10 11 
1  Trucost Total Damage 1.00 
2 KLD Total Concerns 0.59 1.00 
3 SAM Eco-efficiency 0.30 0.39 1.00 
4 SAM Reporting 0.25 0.37 0.74 1.00 
5 KLD Total Strengths 0.19 0.30 0.64 0.57 1.00 
6 PC Environmental Processes 0.05 0.24 0.87 0.84 0.84 1.00 
7 PC Environmental Outcomes 0.90 0.82 0.19 0.16 0.05  —0.09 1.00 
8 Leverage 0.14 0.17 0.14 0.09 0.09 0.09 0.15 1.00 
9 Growth —0.10 —0.10 —0.10 —0.16 —0.13 —0.13 —0.08 —0.05 1.00 
10 Capital Intensity 0.10 0.19 0.06 0.12 —0.01 0.03 0.16 0.06 0.02 1.00 
11 Firm Size 0.47 0.40 0.38 0.38 0.26 0.29 0.43 0.23 —0.11 0.11 1.00 


All coefficients above 0.061 are significant at the 5% level. 


suggests that, all else being equal, a one-standard- 
deviation increase in the PC environmental pro- 
cesses dimension is associated with a 0.116 or 
0.118 increase in Tobin’s q (6% increase relative to 
the mean). The coefficient for PC environmental 


TABLE 6 
Regression Analysis (Tobin’s q) 
Model 
Variables 1 2 3 4 
PC Environmental 0.116 0.118 
Processes (0.005)"" (0.005)° 
PC Environmental 0.030 0.004 
Outcomes (0.568) (0.936) 
Trucost Total 0.000 
Damage (0.408) 
KLD Total —0.051 
Concerns (0.273) 
SAM 0.004 
Eco-efficiency (0.018) ° 
SAM Reporting 0.002 
(0.240) 
KLD Total —0.030 
Strengths (0.518) 
Leverage —0.041 —0.042 —0.042 — 0.042 
(0.000)"" (0.000)*" (0.000)"" (0.000) 
Growth 0.036 0.036 0.041 0.041 
(0.215) (0.230) (0.162) (0.162) 
Capital Intensity 0.100 0.090 0.088 0.088 
(0.026) (0.043)" (0.050)" (0.050) 
Firm Size —0.132 —0.174 —0.168 —0.168 
(0.000)"" (0.000)"" (0.000)"" (0.000)* 
Observations 741 741 741 741 
R-squared 0.27 0.31 0.30 0.30 
Number of groups 391 385 385 385 


p-values in parentheses 


*significant at 10%; “significant at 5%; ““significant at 1% 


outcomes is also positive, but does not differ sig- 
nificantly from zero. To confirm the validity of our 
findings, we repeated the analyses using ROA as 
the dependent variable and obtained substantively 
identical results. As a further robustness test, we 
ran the same analyses with no lag structure and 
again found identical results. 

Interestingly, when we used the individual vari- 
ables that constitute the principal components 
(model 2), only FEco-efficiency was significant 
(p > .05). This is likely a result of collinearity (see 
Table 3) between the individual variables, suggest- 
ing that model 2 is overly specified. With just two 
principal components—which explain nearly 80% 
(model 3) or nearly 95% (model 4) of the variation 
in the five independent variables of model 2—re- 
sults are more reliable. 


CONCLUSIONS 


Corporate environmental performance, like fi- 
nancial performance, is an elusive and contestable 
metric. Yet it is undoubtedly becoming an impor- 
tant one, as attested to by increased reporting and 
scrutiny, with ever-expanding amounts of data 
churned out by corporations, regulators, rating or- 
ganizations, and academic researchers. This abun- 
dance of riches, however, may well constitute a 
double-edged sword. More information can yield 
more precise analysis and verifiability, but it can 
also be misleading and confusing. Our study has 
attempted to identify a useful balance between the 
competing needs for robustness and simplicity by 
assessing the commonality and distinctiveness of 
measures of environmental performance generated 
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by three large rating organizations, each of which 
utilizes a distinct approach. As such, our study is 
unique both conceptually and methodologically. 
Conceptually, we have focused our analysis away 
from examination of a specific rating scheme in 
isolation, and instead emphasized the advantage 
inherent in data drawn from multiple sources. 
Such an approach in essence mimics that of a savvy 
investor with a range of information sources at her 
disposal. Methodologically, we have applied a 
novel approach to examining environmental rat- 
ings that harnesses the discriminative capacity of 
principal component analysis to tease apart the key 
dimensions captured conjointly by the three rating 
organizations. | 

Corroborating prior research, we found that en- 
vironmental performance cannot be reduced to one 
dimension, but that two dimensions are perhaps 
sufficient to depict it accurately by capturing 
nearly 80% of the variance of the data. Whereas 
prior research has suggested a dichotomy of “good” 
versus “bad” dimensions or process versus out- 
come dimensions or historical versus current di- 
mensions, our results suggest that these dimen- 
sions in fact overlap. Processes that companies put 
in place to do “good” and reduce future environ- 
mental impacts constitute one dimension, whereas 
actual current negative releases that are “bad” for 
the environment constitute a different dimension. 

Yet the fact that there are indeed two distinct 
dimensions implies that process and outcome, at 
least as pertains to environmental impacts, are 
much less linked than we would perhaps expect. 
Companies may excel at reporting, governance, and 
the utilization of environmental performance sys- 
tems but still emit substantial amounts of pollu- 
tion. Or, more cynically, they may put in place 
processes for symbolic purposes but not meaning- 
fully pursue substantial outcomes (Delmas & 
Cuerel Burbano, 2011; Delmas & Montes-Sancho, 
2010). Process measures can be easily communi- 
cated by companies, and so are convenient for en- 
vironmental rating purposes. 

If this is indeed true, it is perhaps unsurprising to 
find financial performance uncorrelated with out- 
comes measures yet positively correlated with pro- 
cess measures. Markets can respond only to infor- 
mation available to them. These results are 
consistent with a study by Hawn and Ioannou 
(2012), who found that symbolic environmental 
and social governance has a high positive impact 
on market value. If process measures are more 
abundant and can be easily fed into ratings meth- 


odologies, they will influence market valuation. 
Ideally, these processes would translate into ex- 
pected outcomes. However, as our analysis demon- 
strates, processes and outcomes are distinct dimen- 
sions. Even if one is ascertained precisely, it sheds 
little light on the other. But it is these actual envi- 
ronmental outcomes, with their tangible and mate- 
rial impacts on the earth, that ultimately matter. 
Our financial systems, it seems, have yet to em- 
brace this fact. 

For managers in corporations that are evaluated, 
the implications of our study present a quandary. If 
markets primarily reward corporations for putting 
in place practices related to environmental pro- 
cesses, rather than outcomes, managers may be 
tempted to put processes in place with great fanfare 
and invest less effort in attaining the beneficial 
outcomes that such processes are intended to gen- 
erate. While perhaps tantalizing from a short-term 
perspective, such a strategy may not be wise. First, 
if and when negative outcomes are eventually re- 
vealed, corrective market reaction can be swift and 
severe (Godfrey et al., 2009). Second, as sophistica- 
tion, transparency and market interest in environ- 
mental performance increase, investors are likely to 
become increasingly judicious in deciding which 
actions taken by a firm are truly substantive and 
which are pursued symbolically. For example, the 
addition of sustainability indicators into Bloom- 
berg terminals has the capacity to dramatically in- 
crease the timeliness, specificity, and accuracy of 
environmental measures available to investors, 
making it increasingly difficult to portray token 
accomplishments as meaningful, both environmen- 
tally and financially. 

Similar implications are salient for investment 
managers. By focusing primarily on processes, in- 
vestors do not closely track the real environmental 
impacts of corporations, which may lead them to 
make suboptimal investment decisions. We suggest 
that investment managers are likely to be better 
served by thoroughly understanding the key advan- 
tages and disadvantages of each rating methodol- 
ogy available to them, and selecting from among 
them a set of indicators small enough to be man- 
ageable yet large enough to capture a comprehen- 
sive array of non-overlapping indicators, such as 
greenhouse gas emissions, water usage, and toxic 
releases. Failure to do so may jeopardize the confi- 
dence that investors placed in the capacity of so- 
cially responsible investing to promote meaningful 
progress toward greater sustainability, undermin- 
ing its credibility and raison d’étre. 
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Finally, our research also has important implica- 
tions for researchers in strategic management 
whose work aggregates environmental metrics. It 
suggests that combining the different constructs 
that constitute environmental performance into a 
single index might be misrepresentative of the di- 
mensions of environmental performance. Although 
our study focused on corporate environmental per- 
formance, the concerns we raised are no less salient 
for the measurement of social performance. Further 
research should examine and incorporate these so- 
cial dimensions, integrating it into future analyses 
of corporate social responsibility. 
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